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1. INTRODUCTION 

Many optimization methods have been developed for solving optimization problems. Among these 
are exact methods such as dynamic programming, branch and bound but these are not suitable for large 
scale problems as they have exponential running time. The traditional numerical methods such as 
(conjugate) gradient method and its likes not only require some conditions (for instance differentiability) 
that may violate their applicability to some problems but usually get trapped in local optimums when 
applied to optimization problems with multi-modal objective functions. The heuristic-based methods are 
limited in application to those problems for which the heuristics are devised. The general purpose heuristics 
such as greedy method, hill climbing, and nearest neighbour usually produce near-optimum solutions. 
Indeed finding a method that could produce solution to all optimization problems is practically impossible[1]. 
The only available approach or option we are left with, is then that of developing methods that are able to 
solve some classes of the problem but unable to solve others: each optimization method each with its own 
area of strength and weakness. 

This paper presents a population-based, meta-heuristic method for solving optimization problem in 
a continous domain based on a model that mimics the behavior of a group of shoppers collaborating 
together to identify the cheapest shop to buy some items in a specified area or region. In general a heuristic- 
based method uses a kind of measure or rule to guide the search process within the search space hopefully 
towards the solution. A good heuristic for a given problem enables the search procedure to avoid 
unprofitable path or dead-end (avoiding excessive backtracking) thereby hastening the search process 
towards reaching a solution to the problem ina reasonable amount of time. 

Of a general utility is the meta-heuristic which can be applied to many optimization problems even 
though they could only guarantee near optimum solution (and not optimum) in many cases. A meta- 
heuristic is a high-level procedure or heuristic designed to find, generate or select a heuristic (partial search 
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algorithm) that may provide a sufficiently good solution to an optimization problem especially with 
incomplete or imperfect information or limited computation capacity [2]. In deed meta-heuristic seems yet 
to have a serious rival (with respect to computational time) when it comes to solving large scale optimization 
problem. These other methods 


1.1. Cheapest Shop Seeker: The model and the proposed Algorithm 

The cheapestShopSeekers here proposed is modeled after a group of shoppers cooperatively 
seeking for the cheapest shop for shopping. Consequently the method is a population-based type. A 
population based technique engages a collection of agents to cooperatively explore the search space for 
a solution to a given optimization problem. Unlike a single solution search-based approach that modifies 
and improves on a single candidate solution at each iteration step, the population-based maintains and 
improves on multiple candidate solutions at each step of its iteration. The success of the method hinges on 
the 

a. ability of the individual in the group to remember past experiences (i.e the best position attained so 
far) 

b. cooperation (of group members in terms of experience sharing in pursuant of the common goal). 

c. competition (of group members working to survive or be relevant in the group ). Intent to look for 
position that could improve on the current best global position (in pursuant of the common goal). 

d. Independence and self -improvement of each member of the group: the ability of the individual 
agent to independently determine its own movement and its intent to improve on its current 
position. 

Based on these premises the following assumptions are made to produce the algorithm 

a. The search space is densely packed with shops available for shopping [ each shop isa candidate 
solution or a position to be tested for optimality] 

b. There is a specified number of shoppers (i.e buyers looking for cheapest shop for shopping) 
visiting these shops, all with the common goal : working cooperatively to identify the cheapest shop 
among the shops. 

c. The shoppers communicate with each other ( sharing their experience or adventure — sharing the 
cheapest shops they have attained so far). 

d. Each shopper uses this information received from other shoppers and his past experience to 
determine the next shop to visit. 


e. A shopper at or near the current cheapest shop may sometimes ignore his experience or 
information available and so launch out to explore other positions in an attempt to find a point 
better than the current global optimum point: intent to improve on the current global best (in 
pursuant or furtherance of the common goal of seeking the cheapest shop). 


In making decision about its next position , the i” seeker (for i=1,2,.. populationSize) considers 


adjusting its current position x¥ to xj +e (i.e moving to a neighbouring shop) and then moving along 
the direction (LB — xk ) to select the point, 
u= xf + c*(LBS — xf )+e 


=(1+D')xf + c,*(LBKF — xf) 
where D’ is a diagonal matrix for some diagonal entries. This is obtained by noting that € can be written 
as D'x¥ for some diagonal matrix D’. The addition of € (which can be random or otherwise) provides 


way of enhancing diversification or explorative process. Since I+D’ is still arbitrary due to arbitrariness of 
D’ we could equal write the above as 


u=Dxf + c*(LBE — xf ) 
for a diagonal matrix D. This position u is now compared with the position 


v=xř + rand()* co*(GB* — xj‘) 
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obtained by moving in the direction (GB* — xi ) from its current position x¥. The better of 
the position in terms of the fitness value is then selected: 


v if fitnessValue(v) > fitnessValue(u) 
u otherwise 


However if the position selected is too close to the current global optimum, the seeker, (driven by 
the desire to be relevant, compete, or improve on the current point ) may launch out to explore other points 
in the space ( generating its position randomly) other than those in the directions ( GB¥ — x¥ ),(LBK — xk ). 

By this act the explorative process of the algorithm is enhanced. 


vi = xf + a; (GBT = XN 


uj = x} + c(LB} — xi) 


Figure 1. A show of directions of movement of a particle for the case with e=0 


Based on the model the following algorithm results. 

The Algorithm 

With the following parameters as defined, 

Co, C4 : positive constants probably in the range [2,4]. In this experiment, c, = 2.4, Cọ= 3.5 are 


used. 

dim : the dimension of the problem. 

rand() : a random number generator that returns a random number in the range [0,1] 

x: a vector denoting the position of particle i at time k (i.e at k” iteration) 

GB* : a vector denoting the global best position (among all the particles) ever attained up to 
time k. 


LB¥ : a vector denoting the best position up to time k ever attained by particle i 

distance( u, v) : the geometric distance of position v from u 

minx =( minx), minx), ....., MINXgim , maxx =( maxx), Maxx), ....., MAXXgim ) 

where minx;, maxx; (for j=1,2..,dim) are respectively the lower and upper bound for value of 
component j of xj 

fitValue( z ): the fitness value of position z. 

€ : the bound on the distance of the particle from the current global position below which 
particles generate 

their position randomly The value € =10'° is used in this experiment. 


The algorithm is thereby stated as follows, 
Initialization step: 
a. INITIALIZE randomly the positions x; of all the particles in the population: 


x; = minx +rand() * (maxx — minx), for i=1,2...,n0OfParticles 


b. COMPUTE the fitness value, f; =fitValue(x?), of each particle’s position x? (for 
i=01,2,...noOfParticles). 
c. Set the global best position GB? to the particle position with the best fitnesss value 
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Iterative step: 
for k=1,2,.......... noOflterations do the following looping 


for (i=1 ,....., noOfParticles ) do the following 
{ G) UPDATE x; to obtain x" : 


a v=x + rand()* co*(GB* — xf ) 
b. u=D»xř + c*(LBE — x) 


(with any component of u or v out of interval bound generated randomly as in step (a) of 
initialization step) 


c. If (fitValue(v) >fitValue(u)) then set get =v 
else set xf*1 = u; 
d. if (distance(xf*?, GB*)<e) then = x,;**0) = minx + rand() * (maxx — minx ) 


(ii) UPDATE global best position GB to obtain GB**?, and the fitness value of GB*, : 


if ( fitValue(GB*) < fitValue(xf*7)) then set GB**1 = x#*1 
else GB*+1= GB* 


1.2. Output f ; 
The current global best position, GB”°0fIteration | and its fitness value, fitValue(GB°O/leration) 


2. RESULTS of TEST EXPERIMENT and DISCUSION 

The proposed algorithm was implemented in Java using Netbeans 5.0 and tested on many 
existing benchmark functions devised for optimization search algorithms. The benchmark functions may 
be grouped according to whether they are unimodal (U) having one global optimum point, multimodal 
(M) have many local optimum points and separable(S) being expressible as a sum of functions each of 
which is a function of one variable. Having this in mind the following benchmark functions were 
considered for presentation with results obtained placed on the Tables._The minimization problem is turned 
into optimization problem by negating the objective function (i.e min{F(x)} is turned into max{-F(x)} ). 


FO: Rosenbrock’s(UN): f (x1, X2, --, Xa) = LEFI — x;7)? + 100(xi41 — x;2)?]. Global Min: 0 
at x;=1 in [-3,3] Ê. 


Fl: De Jong’s f(x1,%2,...,%@) = EZ; x;2. Global Min:0 at (0,0,.....,0) in [-10,10] À. 
F2: Schwefel (UN) f(x1, X2 .., Xa) = TLG a: Global Min:0 at (0,0,..,0) in [-10,10] ê. 


F3: Eggerate : f (x4, X2) = (x? + x7) + 25(sin? x, + sin? x,). Global Min:0 at (0,0,..,0) in [-2z, 
2r]. 


F4: Ackley’s (MN) f (x1, .., Xa) = 20 + e — 20 exp (-02 |= 4x? ) = exp(= E$ cos2nx;) 
Global Min:0 at point (0,0,.....,0) in [-10,10]°. 


2 ’ 
F5: Griewank (MN):f (x1, Xp), Xq) = 1+ Leas Ii cos) . Global Min :0 at (0,0,...,0) 
in [-10,10] À. 


1 


F6: Fittasta) = . Global Min:10 at (0,0,...,0) in [-10,10]°. 


2 
d Xi d Xi 
0.1+1+ X17000 7 Tli=1 COS) 
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F7_Rastrigin (MS): f(x1, X2, =., Xa) = EL x? — 10cos2nx; + 10).Global Min:0 at (1,1,..,1) 
in [-10,10] À. 


F8 __Schwefel(MS): f(x1, X2, ..., X4) = 418.9829 * d -XZ x;sin,/|x;|. Global Min:0 at 
x;=420.9867 in [-500,500] í. 


F9_Styblinski-TangQ:f (x1, X2, =., Xq) = : RETEA — 16 x;? + 5x; ).Optimum. value:39.165999*d 
at x;=-2.903534 


F10 Dixon-Price (MS): f(x Xz, Xa) = (x1 — 1)? + ZŁ, i(2x;? + xi-1)2.Global Min:0, in 
[-10,10]* 


F11 Zakharov(MS):f (x1, ..,%q@) = ZŁ xj? + Œ% 0.5ix,;)? + (4, 0.5ix;)*. Global Min:0 at 
x;=0 in [-5,10] ê. 


F12_ Trial 6 (MS): f(x,,...,%q) = XL (% — 1)? — NL, x; x;_1. Global Min:-50 for d=6,-200 for 
d=10, in [-d’,d7]°. 


Tables 1, 2 present the results obtained from the method on the these functions but with the 
dimension 10,20,30,40 and population size 20. The average best ( ave. Best), average (Ave) and the 
standard deviation (Std. Dev) of fitness values were computed over 20 runs of the algorithm with each run 
comprising of 50,000 iterations over the particle population.The parameter values D=[/; ] (with A; = 2.4 
here for alli) , c4 = 2.4, cg= 3.5, €= 10°'° were used in the test. 

The algorithm attains the global optimum for all the functions except on F10 for dimension above 
20 to which the algorithm converges to 0.666667 instead of the optimum 0. Although for dimension 40 
the algorithm fails to reach the optimum for function F2 for population size 20 and 50 000 iterations it 
does reach it when the population and the number of iterations were increased to 70 and 500 000 
respectively (see Table 3). 


Table 1. Result comparing the algorithm with PSO for Dimension = 10 population = 20 
with 50 000 iterations per run 


Func Dimension 10 Dimension 20 
Best Ave Std. Dev Best Ave Std.Dev 

FO 0.000001 0.000002 0.000001 0.000000 0.000000 0.000000 
Fl 0.000000 0.000000 0.000000 0.000000 0.000000 0.000000 
F2 0.000000 0.000000 0.000000 0.000000 0.001855 0.006687 
F3 0.000000 0.000000 0.000000 0.000000 0.000000 0.000000 
F4 0.000000 0.000000 0.000000 0.000000 0.000000 0.000000 
F5 0.000000 0.000000 0.000000 0.000000 0.000000 0.000000 
F6 10.000000 10.000000 0.000000 10.000000 10.000000 0.000000 
F7 0.000000 0.000000 0.000000 0.000000 0.000000 0.000000 
F8 0.000000 0.000000 0.000000 -0.000000 0.000000 0.000000 
F9 391.661804 391.661682 0.000092 783.323669 783.323425 0.000147 
F10 0.000000 0.533333 0.266667 -0.000000 -0.633333 0.145297 
F11 0.000000 0.000000 0.000000 0.000000 0.000000 0.000000 


Table 2. Result for Dimension=30, 40 population = 20 with 50 000 iterations per run 


Fuc Dimension:30 Dimension: 40 
Best Ave Std.Dev Best Ave Std.Dev 

FO 0.000237 6.837006 8.143482 0.037839 17.211248 9.353196 
Fl 0.000000 0.000000 0.000000 -0.000000 -0.000000 0.000000 
F2 0.000000 2229.653809 1231.072388 1628.177368 4119.499023 1432.933960 
F3 0.000000 0.000000 0.000000 0.000000 0.000000 0.000000 
F4 0.000000 0.000000 0.000000 0.000000 0.000000 0.000000 
F5 0.000000 0.000000 0.000000 0.000000 0.000000 0.000000 
F6 10.000000 10.000000 0.000000 10.000000 10.000000 0.000000 
F7 0.000000 0.000000 0.000000 0.000000 0.000000 0.000000 
F8 0.003906 0.003906 0.000000 0.009766 0.009766 0.000000 
F9 1174.98571 1174.985596 0.000281 1566.648315 1566.647705 0.000391 
F10 0.666667 0.666667 0.000000 0.666667 3.235879 9.577686 
F11 0.000000 0.000000 0.000000 0.000000 0.000000 0.000000 
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Figure 2 presents a graph showing the performance of the algorithm with respect to the increase 
in the dimension of the functions with the population size and number of iterations fixed at 20 and 50 000 
respectively. It is a plot of the standard deviation of the fitness values against the functions’ dimension. 
Except on F2, the graph shows thatthe performance of the algorithm on these other functions is not 
much affected with this increase in the function’s dimension. But For F2, the number of iterations had to be 
increased to improve performance as the dimension increases beyond 20. 


1600 —— F0 
1400 F1 
1200 

1000 F2 


Dimension 


Figure 2. A graph of standard deviation of fitness values of the functions against the dimension of the 
functions population:20, number of iterations:50000 


The graph in Figure 3 (that contains a plot of standard deviation against the number of iterations) 
shows the effect of increase in the number of iterations on the algorithm with dimension fixed at 10. The 
graph appears to lend credence to this view that an improvement in the result may sometimes be attained 
with more iterations. 
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Figure 3. A graph of standard deviation of fitness values of the functions against the number of iterations 
for dimension 10, population 20 


The graph also shows that about 5000 iterations are needed to get reasonable result for these 
functions.Table 4 below presents the result from the popular algorithms genetic algorithm (GA),Differential 
evolution(DE), artificial bee colony (ABC) as recorded in [19,20] for population size 50 and 500 000 
iterations on some benchmark functions. Also presented on the table is the result of the 
cheapeastShopSeekers (CSS) (but for population 20, and 50 000 iterations) for comparison. Those 
algorithms with the best results for those functions are written in bold. 
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Table 4. comparing results of the algorithm with those of other popular algorithms CSS (population:20, 
iterations:50 000), GA,PSO,DE,ABC (population:50 iterations: 500 000) Dimension:30 


Fun Algorithm Ave. Best Std. Dev Fun Algorithm Ave. Best Std. Dev 
FO CSS 0.000237 8.143482 F7 CSS,ABC 0 0 
GA 1.96E+05 3.85E+04 GA 52.92259 4.564860 
PSO 15.088617 24.170196 PSO 43.9771369 11.728676 
DE 18.203938 5.036187 DE 11.716728 2.538172 
ABC 0.0887707 0.077390 
F8 CSS 0.003906 0 
Fl CSS, PSO, 0 0 GA -11593.4 93.254240 
DE, ABC 0 0 PSO -6909.1359 457.957783 
GA 1.11E+03 74.214474 DE -10266 521.849292 
ABC -1256.487 0 
F2 CSS 0 1231.072388 
PSO,DE,ABC 0 0 
GA 7.A0E+03 1.14E+03 
F4 CSS,DE,ABC 0 0 F10 CSS 0.66666667 0 
GA 0 0 GA 1.22E+03 2.66E+02 
PSO 14.67178 0.178141 PSO 0.66666667 E-8 
0.16462236 0.493867 DE 0.66666667 E-9 
ABC 0 0 
F5 CSS,PSO,DE 0 0 F11 CSS,ABC 0 0 
GA 0.013355 0.004532 GA 10.63346 1.161455 
ABC 0.0002476 0.000183 PSO 0.1739118 0.020808 
DE 0.0014792 0.002958 


The algorithm is able to match these algorithms (in terms of results) even with population size 20 
and 50 000 iterations (being among the best for these functions even for that population size and the 
number of iterations) except for function F10 where the algorithm fails to reach the optimum (rather 
hanging at 0.666667) for dimension greater than 20. 


3. CONCLUSION 

In this paper a population based meta-heuristic algorithm for optimization problems is presented. 
The algorithm, called cheapest shop seeker, is modeled to mimic a group of shoppers cooperatively seeking 
for the cheapest shop for shopping.The algorithm is tested over some benchmark functions with dimension 
10,20.30, 40 and some of the results are presented on the table above. The graphs depicting its tolerance 
to dimension increase (at least up to 40) and its sensitivity to the number of iterations required to attain 
optimum are also presented. A comparison of the results the algorithm produced on these functions and 
those recorded in [19,20] for genetic algorithm(GA), particle swarm optimization (PSO), Differential 
evolution (DE) and artificial bee colony(ABC) was also made and presented.The algorithm appears to have 
a better success rate of reaching the global optimum point and with fewer number of iterations required to 
attain it.The simplicity of the algorithm compared with some of these algorithms is another feature of the 
algorithm. 
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